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ABSTRACT 


A Gomearison of several techniques iSepresented for 
determining upper confidence levels for a system failure 
rate. A series system of components with exponential 
failure rates 1S examined. Classical computational tech- 
niques are compared with Bayesian techniques in determining 
Bec per cOonricence level of a system fatlure rate. A 
Semoitcivaty analysis 1s conducted on several of the 


Parameters as part of the comparison. 
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I. INTRODUCTION 


A. BACKGROUND 

Numerous "classic" techniques have been used to compute 
estimates of failure rate and mean time of failure. From 
these estimates standard accepted procedures can be applied 
to establish upper confidence levels (UCL) for the failure 
mace or Wewer confidence lewels (LCL) for the reli@bility. 

One well established "classic" procedure is to utilize 
the computational methods set forth in Ref. 3 to determine 
teper confidence levels -en@system failure rates. This is 
the procedure used for all "Classic" and "Semi-Classic" 
methods presented in this paper. 

The application of a "Bayesian" technique may be intui- 
tively appealing to some. Results from previous experiments 
and testing could be applied apriori to current testing 
programs to determine failure rate and reliability. By 
using a prior in such a manner perhaps total system test 
time, number of component failures, etc., could be reduced, 
thereby reducing the overall expense involved with system 
life testing. This would appear to be most appealing when 
testing systems that are extremely expensive. 

Thesintemt of this thesis is to attempt to determine if 
it would be more advantageous to use some "Bayesian" tech- 
nique rather than a more traditional "classic" technique 


to compute upper confidence levels on a system failure rate 
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when the "prior" for the Bayesian method could be chosen 


as “optimistically" as one would desire. 


B. SYSTEM ASSUMPTIONS 

Since it is the technique of computation of the upper 
confidence level that is being investigated, the system 
that is being modeled can be kept simple, yet still 
realistic. 

Even the most complicated system can be broken down to 
a system of components, connected in series, which the 
total failure of any one component will result in the mis- 
sion failure of the system. 

Each type component in this series system experiences 
exponential failure rate. The failure of each type of 
component is assumed to be independent of the failure of 
any other type of component. Wearin and wearout are neg- 
lected and the failure rate is assumed to be constant. 
Components are assumed not to ever be "stillborn." To 
keep the system.as simple as possible, each type component 
exhibits an identical failure rate, A, = A 


1 1 
k equaling the number of type components that are connected 


dee © 2 Ae Se ee 


in the series system. The following formulas concerning 
system failure rate and system reliability are assumed to 


be valid for this system: 





r 


oP a: exp Ss 


In keeping the system as simple as possible the 
ems tice prior’ for the Bayesian computations are also 
chosen to be equal for each type component, a, = ao; and 
1s Bs; OW =o D2 oe ee 

For purposes of comparison, it is assumed that each 
imme Of Component is placed on test for an equal length of 
time; t, = tj; 
Same number of failures during its total test time, 


and each type of component experiences the 


fy = f.. This assumption is modified slightly to be able 
to Cxamine the Systemetnar has only one component failure. 
A system exhibiting two component failures is also 
examined. 

The data (values of the parameters) have been chosen 
by thle author. They "have been intentionally chosen to be 


computationally simple yet to still exhibit the characteris- 


tics Of a wWealistie system. 





II. COMPUTATIONAL METHODS 


a §@€6©«CLASSTC 

Reference 3 is used exclusively for the computations in 
this method. The computational formulas given in this 
reference are modified slightly to accommodate the basic 
assumptions of identical test time, identical number of 
ferlures for each component, etc. 

X. is a Maximum Likelihood Estimate for the failure 
mace OL the ris COmpoOnciites It wk be equal to the total 


number of failures divided by the total test time. 


aA f. 
A; = =. 
i ES 
ms the system failure rate, will be equal to the sum 
a k 
of the individual component failure rates. d, = ds 
1=1 


Each component is assumed to fail independently and k w: .1 
equal the number of components that are placed together 
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dn will be an upper confidence level on the system 


failure rate. 
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Tre values for K' are found in Table 1. The computational 
Peoecamre CO detemmine the Beta yealwes for a 90 per cent 
level of significance are also discussed. Eighty per cent 
level of significance values are found in Ref. 3. 

A formula for the upper confidence level for the system 
failure rate is also provided when no failures have occurred 
during the total test time that each component has Seen 


allotted. That formula follows: 


where n equals the number of component terms in the 
Summation. 

Substitution of the upper limits on the failure rates 
obtained will generate corresponding lower confidence 


limits on reliability; thus 


= -Ay 
Ri exp 5 


Beta can be calculated from the following formula: 


x - X= Beta (Kk) (x,)//? 


x 1s obtained from Chi-Squared tables in Ref. 1 at 
the desired confidence level with 2(X+1) degrees of free- 
dom where X is the number of failures and K is the 
percentage point of the normal distribution point in the 


same confidence level. 
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TABLE I 


BETA VALUES FOR 90 PER CENT CONFIDENCE 


X 


ital ie Me oe x11) coin eae ee 

0 4.906 2. SNe iese2 eo isan 

1 1 7S 3.889 1.14271 1046496 
2 10.645 oes 1.12336 1.44015 
3 13.362 6.681 1.1109 1.42417 
4 WS, O29 7.994 1.10188 1.41261 
: 18.549 J, oye 1.09494 1.403713 
10 30.813 15.406 M0743 laa aes 
20 54.090 27.045 1.05669 1.35468 
30 INTERPOLATED 1.34639 
5665 oe 1 45.55 1.04596 1.34092 


The "Beta*Value” lasted in this table is germane to 
Ref. 3 and should not be confused with the 8 that is the 


optimistic scale parameter used in the Bayesian simulation. 


B. BAYESIAN 

The Bayesian technique will assume the apriori density 
ito be Gamma (A;;a,,8.). Os and B are the shape and scale 
parancres = tiem pier" can be mades”"Optimistic" ~sieathe 
scale parameter is chosen large in relation to the shape 


parameter. 
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The a posteriori density then becomes (A, 5a, +f. ,8.+t.). 
f. will equal the number of failures of the jth ty perc on 
ponent and t. will equal the total test time for the reo 


type component. 


l ae 


The distribution of d = hs will then be determined 


i=1 
by computer Simulation. Random variates of each ds are 
generated from the Gamma distribution with parameters 
a f., 8. + t.. A random variate will be generated for 
each he» 1 =1,. . .k, the number of components in series. 
The ae will then be added to determine the series system 
faa lure rate. 

The process for generating a system failure rate is 
thien repeated 1000: tames tow y edd ASL? hoo a 51000° 
The 1000 random values of d. are then ordered to yield 
Asa say aloo)” 

A suCy) is the "estimate" of the (1 - ayo percentile 
point of the distribution of he: 


The Bayesian 100(1 - sy upper contidence level for 


A, is then A STLNOOCL = y)° 


At the time of this writing a subroutine to generate 
random variates from the Gamma distribution does not exist 
in the Naval Postgraduate School computer library. Reference 
2 was used to pees random variates from the Gamma 


distribution with an integer shape parameter. 
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The, generation of random variates with a shape parameter 
that is not an integer poses a much more complicated prob- 
lem. Reference 4 has been written to handle this situation 
for shape parameters between @.05 and 1.0. Although 

LT Robinson's approach is relatively untried, it shows a 
great deal of promise and may possibly be incorporated 

into the Naval Postgraduate School computer library in the 


future. It has been used in this writing for comparative 


purposes for a shape parameter less than 1.0. 


ee oni CLASSIC 

similar to the @@assic teaemmuque, Ref. 3 1s used to 
compute the upper confidence levels for the system failure 
rate for this method. The computations will be modified 
somewhat by adding the identical "optimistic" priors used 
in the Bayesian technique. 

The number of failures per component will be added to 
as and the totai test time per component will be added to 
B.. A maximum Likelihood Estimate for the ea component's 


1 


faalure is then: 


The system failure rate for this Semi-Classic method is 


the same as for the Classic method. 


>> 

" 
fun 

2? > 


q 
| 


3 





The value of C will also change slightly: 


When no failures have occurred, the upper confidence limit 


on the failure rate now is: 


Z 
dr 5 ee SO, 
u 


=: 

ct 
+ 

WD 


The computation for the upper confidence level with failure 
remains the same. 

This method is somewhat "Bayesian" in the sense that 
it iS utilizing a prior but it is "Classic'' because of the 


nature of the computational method: 
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IIIT. PARAMETERS OF VARIATION 


Although the range through which some of the parameters 


are varied could be more extensive, it does provide the 


reader with 


computation. 


an adequate base for comparing the methods of 


Owe Oss 
50,00i0.0 
30, 50, 100 mission units 


1.0; 0.0) fhe moamilures are“also modified so 


that f, =], f, = f. = 0 and fy = ], f., = l, 


Z 
f. = f., f. = 0. This will provide the 


reader with the opportunity to compare a 
System where only one component or only two 
components fail. 


Ll, 220, SO components 


Oe 
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IV. COMPARISONS OF SYSTEM FAILURE RATE 


UEEER COlr EDENCE LEVELS 


The following 12 tables provide the reader een upper 
confidence levels computed from the same data by the three 
different methods: Classic, Semi-Classic, and Bayesian. 

A program to generate random variates from a Gamma 
distribution with a shape parameter that was greater than 
Pee but Not an integer was hot available; therefore UCL's 
for the Bayesian simulation could not be computed for the 
case when the shape parameter was less than 1.0 and a 
failure existed for the ae component. 

All calculations were conducted on the IBM 360 computer 
with the exception of the Classic method with zero failures, 
whose calculations were computed on a desk calculator. 

For each three-line block of numbers the reader may 
compare the three methods' upper confidence levels com- 
puted from the same arguments. To see how a change in the 
scale parameter, the number of times a component fails, 
or the number of components in series 1s reflected in the 
upper confidence level, the reader merely moves to the right 
or down in the table. If the reader wants to see how a 
change in the shape parameter or a change in the amount of 
time a component is on test is reflected, he must go to 


another table. 
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¥. GONGLUSIONS 


A Gerascover! pomt aethis discuss ionmwrll be defined 
as the point or general area at which an upper confidence 
level that was previously lower than one with which it was 
being compared becomes higher. 

The Bayesian method will be compared with the Classic 
and the Semi-Classic will be compared with Classic. The 
Bayesian and the Semi-Classic appear to behave similarly 


and remarks concerning this similarity will be mentioned. 


A. UNMODIFIED COMPARISONS, ALFA = 1.0 

The first three tables deal with a shape parameter of 
1.0 and a system of components that either all of the 
components eXperience a failure or none of the components 
Experience a failure. 

In the cases where none of the components fail, a 
crossover point is exhibited in every case when five or 
more components are in Series, regardless Lf how*optimistic 
the scale sonaneeer becomes or how long the test time is 
extended. When every component fails, the Bayesian and Semi- 
Classic systems do not crossover. In both cases the values 
of the upper confidence level for the Bayesian and the 
Semi-Classic methods become closer together as the number 


of components increases. 


Zo 





B. UNMODIFIED COMPUTATIONS, ALFA = 0.5 

The wpper confidence levels for the second three tables 
(less the Classic) are computed with a more optimistic 
prior shape parameter (alfa = 0.5) so naturally the UCL's 
for these two methods are lower than those shown in the 
merst timeee tables. 

Crossover points are much the same as in the case when 
alfa = 1.0. The Bayesian and Semi-Classic methods cross- 
ewer when none of the components fail; only Eeeecrossover 
point occurs when about 10 components are placed in series. 
The Semi-Classic does not crossover when all components 
fail (the Bayesian is not examined due to the non-existance 
of a Gamma random variate generator with a non-integer 


Shape parameter). 


C. MODIFIED COMPUTATIONS, ALFA = 1.0 

The third three tables provide a much more 
mrerestany comparison.” Here “the situation where only 
one (or two) component(s) in the system fail. The Semi- 
Classic and the Bayesian techniques will crossover the 
Classic system in every case regardless of how optimistic 
the "priors" are or how long the components are tested. 
When the priors are more optimistic and/or the test time is 
larger, then it takes a larger number of components in 
Bemies for the crossover to occur. This point may occur 


with as few as two components or as many as between 10 and 
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30 components. The Bayesian UCL's are strictly lower than 


the Semi-Classic UCL's. 


D. MODIFIED COMPUTATIONS, ALFA = 0.5 

In the last three tables only the Semi-Classic and the 
Classic methods can be compared for the Bayesian cannot be 
Simulated for this case (non-integer). 

The Semi-Classic technique is using a more optimistic 
prior so its UCL's are lower than before but again in every 
case it will:crossover with the Classic method. 

Generally one could conclude that as long as the 
number of components that are in series in a system are 
few, the Bayesian approach may yield a lower value of an 
upper confidence level for the sysitem failure rate, pro- 
vided the priors can be chosen optimistically. If the 
System 1s complex enough that more than "a few" components 
must be placed in series then the Classic system appears to 
Viewastne lowest valwes of upper confidence levels. The 
~emi-Classic technique would only be useful if the priors 
Wee OptilMisitic, the number of Components in series were 


few, and the optimistic priors were non-integers. 
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COMPUTER PROGRAM FOR THE SEMI-CLASSIC METHOD 
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COMPUTER PROGRAM FOR THE MODIFIED SEMI-CLASSIC METHOD 
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COMPUTER PROGRAM FOR THE BAYESIAN SIMULATION 
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